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D 1 f f erent i a 1 D i agnos i s- Pr escr i pt i ve Teaph i ng : \ 
* ' A Cr i t ica 1 Appra i sa 1 
The term **cl i f fe^-ent i a 1 diagnosis*' refers to the process of 
assessing the learning characteristics of a child so that insiruction 
can be matched to individual learning needs (Kirk'S Kirk,*197i, p.^12; 
Kirk, 1972, p. 7). Although, in theory, this could include a^y pro- 
ceduf^ that attempts to delineate a child's specific st<enigths and 
vyeaknesses (Y^seldyke & Salvia, 197^), it has*tradi tional ly deferred 
to those practices that attempt to diagnose abilities that presumably 
aVe prerequisite for or underlie academic learnirfg (Mann, 197^; Yssel- 

dyke, ^973l)4 Such general psychological processes include auditory 

' • , '1 

abilities (e.g., auditory discrimination and memory), vi sual *abi 1 i t ies, 

(e.-g., visual discrimination and Spatial relatipnships) , cress sensory 

perceptual abilities (e.g., auditory-visual integration) and ^ycho- 

lin^uistic abilitres (e.g^, auditory sequential memory and verbal ex- , 

pension). According to this fnodel, failure to master basic academic . 

skills, such as reading, may be tracedjto impairments in one or <ftre 

*of^these underlying processes or abiHtfes. To illustrate, a child? who 

experiences failujf^ in school tasks such as spelling phonetically irreg- 

Ular words^ answer irig" sequence questions based on material read, or 

copying sentences, may be found to suffer from an impairment in a 

basic process such as visual ^quential memory (the abMity to ord^r ' « 

a series of items so as to matcfjF' a. previously given model). . 
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^ ■ :• ' ; . 3 ^ 

The term "diagnostic-prescriptive teaching," often used in conjunction 
with Differential Diagnosis, refers* to th'e- pract ixe of formulating instruc- 
tional prescriptions on the basis of d i f f eren 1 1 a 1 .d i agnost i c results. 
These prescriptions generally take one of twp forms. In one form differ- 
ential diagnostic information is u5ed to generate a program to directjy 
remediat^e an underlying ability weakness. In a second form weak abilities 
ace not remediated: rather, the focu^'is on academic t^r^ets, sucb as \ '4,, 

• . . ^ ... - /-^r* 

reading or math, for whLcn i nstruct ional programs are devised that capi- * 

\ • ' • 

talize upon the child's pattern of underlying strengths and weaknesses, 
as identified in the course of diagnosis. An example* of the former 
approach would be provision of visual discrimination and visual memory 
exercises tor the'^chi Id whose diagn(jsis indicated weaknesses in these 
areas. An example of t\ve latter strategy woj/1d be identification of an , 
auditory or visual learning pjittern ^o that reading* instruct ion could b^ 
geared to the stronger modality; . ^ 

In this^ paper the terms differential diagnosis and diagnostic- 
prescriptive teaching are'combined as D i f f^r^nt i a T Di agnos i s-Prescr i pt i ve 
Teaching (DD-PT) and refer to the psychometric practice of assessing 
underlying abilities and devising subse<5uent Instruction in accord wit'K' 
,ability strengths and weaknesses/ Haring and Batemarl^ (1977, p. 133)^ 
have described this approach as the^ "major i ty position within the field 
of lear'rfing d i sab i 1 i t ies' over the^past 20 or 30 years." The DD-PT label 
encompasses a number of ."process" models which are fundamentally equiv- 
^^lent but whfch have gone ^y a varirty of names. Acco^rding to Haring 
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and Bateman, **Thi6 conceptualization [the DD-PT model] has been known as 
V*' • ' ' ^ - ' . , * . 

„the__d i_agnqs.tj.c- rernidjal approach , {B^t^mn ^ 1967} t prescr i pt i ve teaching 
(Peter/ 1965), ability and process training (Yssel'dyke & Salvia, 157^) » \ 
psychometfic phrenology (Mann, 1971) and even^ta^k analysis CJohnson, 

/1967)." (Haring & Batema^n, 1977, p. 130).^ 

The Proliferation of Dg-PT ^ 4V 

In ntce^t years special education has witnessed a proliferation of 
tests and training programs designed for DD-^.T. Sabatino (1973) Ijsted 
17 assessment protocols tbat contain one or more subtests for evaluating 
audftory perception,, along with I6 prografT\^ that have is a major goal the' 
remediation of auditory perception. Ysseldyke (1973) and Goodman and 
Hammi II (1 973%^^tdent*i ffedJl tests ♦des i gned to 'assess^vi sua I pe rcept ion , 
f^sycholingui St i c* processes , and motor skills. Kepgh (l97/») identified ** 

. ' I 

16 authors who have developed visual perceptual training programs. 

• % ' - 

Several factors may account for thi s prol i f erat ion of tests and programs. 

- Rejsemblance to task analysis .- First, in the DD-PT model, the practice ) 
of analyzing academic skills into their components bears a strong resem- - 
blance to task analysis. Task analyti^ approaches to instructional' 
p'rogramMing are themselves qoite popular. In the task analysis mod«l ' j 
^'specific behavioral components are identified aod prerequisites for .each 
" are determined. The strategy is to develop learning object I ves *such that 
» mastery of objectives in the hierarchy (s4mple tasks) faci I i tates l^arn-' 
Irig of higher objectives (more complex tasks)'* (Resneck, Wang & Kaplan, 
1973, p.' <^9)- Simi larly, *the DD-PT model holds that academic tasks' must 
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be analyzed into bas i c "components . Here though, the ba*slc components- 

* . ■ ■ " ^ 

c'onslsf of underlying ab i 1 i t ies or psychoTogTcaT process IT wealc- 

\ 

nesses are discoyerad at the foundational o'r ability leve'l, they must 

** " 

be remed i ated -before proceed ing to higher order skills. 

Although the task. ana 1 yt i c and DD-PT models appear to be similar, 

» f 
we believe that the similarities are quite- superficial and that serious 

differences exist between the two. The differences between tbe models 

lie both in their level of analysis and their implications for instruc- 

tion. With reference to- the Fevel of analysis, the task analytic model 

breaks down larger general tasks into sets of smaller specific task$. 

These latter tasks are s i gn i f i cant on 1 y insofar as they are directly 

related to the ne^t'higj^^r task. In contrast, the DD-PT model analyzes. 

academi c Xasks into abilities or processes (e.§^., vjsual memory) that 

are seen as s i gn i f i c^^ .for a wide variety of higher level tasks.' * ^ 

" ... • ■ 

With reference to instructional implications from thg two models, 
the task analytic approach ma i n ta i ns ,that a teacher needs' only help the . 
chTld mastet-^ec I W c ta^ks in^Y^re hierarchy that have not been mas^^red. 

In the •DD-PT mpde'l the teacher is f^ced with a far more serious challenge-- 

. ■ * ' ■ ■ \ 

tOTem^diate o^ strengthen an entire process. This rejquires that .the 

teacher demons-^rate^ improvement ' or "mastery'* of a large number of, 

'specffic t^kSj jsach of(i which are thought to depend upon or tap that 

part-icular process. ^ '^^^ ' . ^ • j. 

As an i i^strat ion of the -dii^ferent, instruct ional. impl icatjons of^' 

these mode 1 s ,* suppose that a child encounters difficulty in learning 



G • 



•OD-fT: A Critical Appraisal 
to cpunt objects. A task analyt ic teacher might determine that one 

— Y ' . ..,.v^. V f, 

prerfequisite fos, qount ing object^ is recitation of numerals in order. 

In contrast, a DD-PT teacher might formulate the same piroblem more 

% f ^ , ^ , 

generally as an auditory sequential meroory deficit. While the task 

analytic teacher can satisfy the imme^iaie teachi'ng objective by ^ ^ 

helpirtg the #tudent learn rote counting, the DD-PT teacher, to satisfy 

the immed i*ate rteach i ng objective, must improve the chfld^s abiPfty to 

recite lists of spoken events which are" ar b i t rar i 1 y ordered (e^.g. , color 

names, animal names, articles of clothing, andi p,er,haps numbers). Thus,^ 

in the DD*PT model the teacher is >^ewed as teaching general abilities, 

in the task analytic fr>odel the teacper is seen as teaching specific 

components of academic tasks. Clearly, these two nx^dels, although they 

appear to^be similar, lead to, very different types of instruction. 

Pressure to develop effective renfediat ion techn i ques . Bes ides DO~PT' 

resemblance^o task analysis, another factor accounting for the prolif- ^ 

m _ 

eration of DD-PT tests and' teaching materials has been the pressure felt 
by specia'l educators^ to deve lop effecti-ve and innovative remediation 

techniques. This pressure is due in part to the unflattering outcomes* 

' ' ' « * * 

of special education efficacy studies, to the financial expenditure^ 

associated wi th special educational services, and now^ to regular education 

expectations of effective special education contributions in the context 

of mainst reaming. Older', more g loba 1 , assessment instf*uments ^(e.g., IQ 

tests), although sometimes useful f or adml a i s t ra^i ve act lons" (e. g.|, place- 

ftjent of children in categorical programs or procurement of state reim- 

bursement for special programs ]| appear to be inadequate for planning 
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m 

individualized programs of instruction. Effective individual remediation 

t, , , . 

^requires more spec! fic assessment information (Ki rk & Kirk, 19?l)^^and 

* * ' ' • *' 

differeqtial diagnostic instruments appeared to me'et this need. 

Needs of early childhood education programs . The, DD-PT approach, 
wUh its emphasis on psychological abilities, appears also to have 
benefited from the growth of early childhood education programs. Instru- 
ments-were needed to structure curriculum end. evaluate program effects 
of such federally funded ventures as Head Start. Since academic skills 
themselves were not to be taught in these preschool pro-ams, some 
wortiiwhile preacademic goals had to be identified.. Linguistic and^er- 
ceptual processes became prirwe training targets since thefy were hypoth- 
sized to be essentia>^o the future acquisition of aca^mic skills f 
(Sedlack & Weener, 1973). \ ^ 

Differentiation of special and regular education . The DD-PT mpdel 
'appealed to special educators because it served ta d i f f eren t i a te their 

c } * 

effort from that of regular education. While regu 1 ar ^educators concen- 

tr^ated on reading, arithmetic, etc., special educators focused on more ^ 

basic, underlying processes. This division helped to clarify the 

respect I ve^ roles of regular and special edufcators, and to reduce potential 

^ • ' ' . 

territorial disputes between the parties. 

Support from authorities . Support for DD-PT from special education 
authorities hes been strong. The following quotations are i 1 lasf/at ive. 
The visual dyslexi.c rarely is able to learn by an ideo-visual 
' approach since he cannot associate words with their meanings. 
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He cannot retain the visual image of $ whole v^rd and conse- N * 

jquently needs a more phonetic or elemental approach to reading., - 

■ \ 

.(Johnson & Myklebust, 1967, p. 156) - 

Many children are coming into our schools lacking in basic ijer- 
ceptual-motor ski 11. '...We [need] to help the child to build up 
the sensory-motor skills which are required by the more\ complex , 

activities of reading, writing and arithmetic. (Kephart, I960, 

, * ^ 

' p: 16) . ^ 

The major empTiasis /t>f the concept of learning disabilities] 
■ 'V 

is the use of psychological tests and/or observation for the 
. purpose of organizing. . .a remedial educational program. Such 
a program*. . .M s very dependent upon the determination of psycho- 
logical abilities and disabilities. ^(Klfk & Kirk, 1971, P- 1$) 
A child's learning type--his maximum mo^i 1 i ty--needs to be under- 
stood before a particular approach to reading can be determined 
for hirr?. .. .Today this determination can be made with reasonable 
accuracy, (Wepman, 1967, p. .355) \ 
Encouragement from publishers . Putvlishers of e^cational materials 
have foJnd it lucrative to-deve1op 3nd market an array of ability assess- 
ment instruments and related i ns t rue t i ona 1 . mater i a 1 s* New tests and 
training materials appear on the market alqjost daily.' School systems 
invest heaviJy to purchase DD-PT materials for their special education 
programs. Special education teacher tr^^ing programs devote consider- 
able resources to i nstructi on- i n the philosophy and implementation of% 
DD-PT assessment- devices and instructional materials. 
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We believ4 that the widespread ^doption of DD-PT warrants a critical 

appraisal of the ipodel's efficacy. To date, experimental studies and ' 

reviews of literature in this area have focused on isolated aspects of 

♦ 

DD-PT: the present paper is an attempt to consol idate information in 

order. to present a comprehensive picture of the support for and efficacty 

of the OD-PT model. We will examine the basjic assumptions of DD-PT and 

evaluate the extent to which data f^'om diver.se studies support those 

* » 

assumptions. In producing a reviesw of the DD-PT literature we hav« found 
it both necessary and valuable to draw extensively on other published 
rev-iews of particular aspects of the DD-PT model.. Therefare several 
reasons for this reliance on secondary sources. First, the literature 
^ varrous aspects of the DD-PT is so extensive that a comprehensive 
review- of primary ^sources would be prohibitive. hn addition, it would 
be unwise to ignore the unique and valuable contributions of a number of 
scholars to the analysis of the^DD-PT literature. Finally, many of the 
existing reviews lend themselves well to our Tpur pose because they pr^ent 
summary data in tabular fornr, permitting individual reanalysis as 
warranted. Primary sources\/ere consulted only when the review articles 
were unclear or contradictory, or when studies were reported after tbe 
most recent revi*ew. ^ 

ASSUMPTIONS BASIC TO THE DD-PT MODEL 
Underlying the DD-PT model are. several assumptions regarding psycho- 
logical abilities and their relationship, to pcademic sRills, the measure- 
ment of these abilities, and their susceptibility to mod If i cat ion through 
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training. The five basic assumptions of OD-PT that are presented below 
have^ been synthesized trom various authors: Hammill (1972), Larsen and 
Hammill (1975), Mann ( 1 971 ) , Proger , Crfess,^ and Burger (1973), and 
Ysseldyke (1973)- Along with each assumption we have attempted to 
■specify the kinds of empirical evidence which would -be us.eful in evaluating 

i 

.thei r val id! ty. 

Assumpt i on '1 • . * • . 

Educationally Relevant Psychological Abi 1 i ties Exist 
and Can Be Measured 



The psychological abilities referred to here are not themselves 
directly observable but must be^ inferred from behaviors which presumably 
require t{ie hypothesized ability. -These abilities are referred to as 
underly-ing in the sense that they^ are foundational to academic skills. 
Each ability general in that it is important for # number of academic 
behaviors. In another sense, each ability is«specific in that i»ts 
"Strength may be "i ndependen t of the strength of other abilitfA* Thus, 
for an Individual student, it is theoretically possibl^for visual 
reception to be strong but- for vfsu^ memory to be wesK. 

Assumption 1 would be suppor ted'^'by data documenting the success- of 
the DD-PT model (either in remediating ability deficits or in accelerating 
a'cademic performanc^ by capi tal izing on ability strengths) or by data 
supporti^ng the reliability 6r vaTldity c*laims of the instrufne^j fr^-^ 
quentj^y employed by the model. In the absence of such data. Assumpt ion 1 
could be questioned. However, even without supporting dat* this assumption 
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cannot be disproyen,. i s. ^impo^'s i ble .tq^^Vove that ^ucationally 

relevant underlaying' abi 1 1 ti,(^s»(J^ not^x^at, S ixi^^e if Jai lure's to measure 

* ' * ' "'^ "ilt^; — ^ . ' ' ' * ' 

or remediate abi 1 i t^tTw^were-,dodumeht4d, they could be attrit^Uted to the 

inadeqija#ies of present day ^measurement arud Instructional technology.- 

These previous failures would not necessari?-y ref-iect^f/on what could * 

ocpur in 4he future through improvements j n 'technology . tlev^rthel^s , 

such fftiAures as' those mentioned above should raise doubts ^bout the 

validity of Assumption I.- In contrast to Assumpt i on 1 the rema-ining . ^ 

assumptions have been expressed' in ter^ of existing technology. 



, Assumption 2: 

Existing lests Used in Differential Diagnosis are Reliable * 
The DII-PT model assumes that abilities which underlie academic 
learning are stable, non-ephemeral individual traits. -Thus, an instru- 
ment ^hich purports to measure these abi lilies should result in rela- 
tively constant scores on repeated testirrgs or on different parfs of the 
same' test. If such consistency i^ not ob'SCTved, it would naturally- 
Vaise doubt about the capability of the tesit to produce reliable infor- 
mation on the target ability. For there to-be conf i dence J n .the results 
of differential abftity tests, of fjDr #iat matter, for the 0£)-PT"moder 
to be j^mployed effectively, it is essential tpat tKese tests produce a, 
picture of perfdrmance* that is r§i.lat ively stable over -time. - 

.The evidence relating to the re 1 i abli 1 i ty ^Jf DO-PT instriiments ' i s 
straightforward, coming from studies of test-retest renabi 1 ityan'rf st ud i 
of internal, consi stency. The rel Pabi'l itics associated with a parti.cglar 
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instrurtient'must. Bll high enough to warrant that instrument's use in 

t ' ' ' 

making educationally significant decisions. Otherwise, efforts* to 

generate -preci se instructional prescriptions wou>d misspent. 
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; , Assumption 3:. / 
Existing Tests Used , for Differential Diagnosis j^^}L{ 
Validity refers to the extent td which a test measure^ wKat^i.f Is 
supposed to measure.' The validity data generated with regard to PD-PT 
i^, cJassi f ied into C-oncurrent and predictive criterion validity.^ diag- 
nostic va 1 id i ty, and , construct val id i ty. Al though the i'nformation^ ^ ^ .^ 
geneisated .by ep^amining on6 type of validity is corroborative evidence ^ 
for the others, each type of validity wi { 1 be disqjssed separately. 

Concurrent Criterion Va^d i ty ^ , 

To assess the concurrent criterion validity of an instrument used 
'in Differential Diagnosis, dne determines\the extent to which fte results 



obtained with thi 5^ i n^trument corre^^ate with measures of academic achieve- 
ment taken at the same time: Since weak abi Utiles are assumed to impede 
adademic achievement, childreri who obtain low scores dn ah ability 
measure should obtalft similarly low scores t>n measures of academic * 
achievemeot. . Likewise, ^chi idrtn obt^iining scores indicating an abi^ity;^. 
.strength should, on the average, score high .on achievement mea^ures^ 

Predrjctiv^ Criterfbn Validity . . ^ 

• ' » Fof a* DO-PT test instrument to have predictive crlteritJn validf-ty, 
children's scores on- it should predict their later academic achievement: 
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Ev*iden<p^ cojisists of correlations between an abi 1 i py 'measure given at 
orle tijne'and a measXTre of academic achievement given at a later time. 



^pin, sihce ^eak* abi'l i ties s>>j)uld hinder academic success, children" 
receiving low ability scores Sh'ould perform poorly ph subsequent achieve 
,ment tests , ^ re 1 at i ve to children receiving high ability scores. 

Diagnost ic Val i'di ty 

This type tf validity is similar to the concur rent cr i ter ion type, 
except that the procedures for estimat'ifig validity differ. Whereas 
investigations of concurrent validity correlate performafice on ability 
ancf achievement measures, studies of diagncfttic validity group students 
■according to their performance on one measure (ability or achievement) 
and then examine the i r' performance on the other measure. To illustrate, 
an abijity assessment device js^said to have diagnostic validity if 
children who are -i ndependent 1 y, i dent i f i ed as poor readers via an achieve 
•ment test also perform significantly worse on that ability measjure than 
chlidren identified as good readers. 

Construct . Val i di ty •« 

^^In assessing thd construct validity. of PO tests, attention is - 
^directed fo the theoretical model upon which the tests are based. 



Construct validity is the' degree to which the test measures an hypo- 
thetical variable. Thus, "construct validation recjuiref the gradual 
accumulation of information from a variety of sources. Any da^a » . 
-throwing light on the na'ture of the trait under consideration and the 
conditiorts affecting its development and man i f estat ion are grist for 
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this validity mill" (Anatasi, 1968, p. 115). In the broadest ,sea§e , 
all of the previously discussed types of validity can be viewed as 
evid^ce relating taconstruct validity. Jn our, exami nat i on of • 
construct validity we focus on factor analytic studies that investigate 
the independence of var ious 'sutjtest,^ used in differential diagnqsis, 
(e.g., the 11 subtests of T:he Mlinoi^ Test of Psychol ingulstic Abilities 
^ITPA] and the f i ve' subtests of the jDeve lopmenta 1 Test of Visual 
^Perception ^[ DT\/P ]) . Since the DD-PT model assumes that subtests of a 
larger assessment device ^provide information that isu.crucial''*for instruc- 
tional pro'grammi ng^i t i s - i mp'or tant to demonstrai^ that these subtests 
tap different abilities. ^ ^ 

'-^^w } ^ Assumptions j^^'J^^t^^'- 'a - ^ ^ 
4A: Prescr r^pt ions Canv Sfen^rated from Differential Diagnosis - 
to Re[nediate Weak Abili^ties ^ 
kB: Remediation of Weak Abjfities Improves Academic Achievement 

According to the DD-PT model, failure to acquire academic skills is 
the result pf one or more underlying ability deficits. Application's of 
the model may take two forms. Assumptions ^A and B relate to the first 
form which involves the direct training of weak abilities with*^the 
intentioijj of 'streri'gthening them. This accomplished, the impediment to 
academic achievement is removed, 'and the child's prbgress can be ex- 
pected to accelerate-^ Thi s as^unpt ion would be supported by evidence 
that ability traigiog strengthens weak abilities and enhances academic 
performance. 
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^ i> ' >Assufnpt ior\ 5 : ^ ; 

P-^^cr Iptions Can^Be Generated from Abiljty Profiles to lmf>rove 

Academic Achievement^ WitltNo DiVect Trainings of Weak Abilities ' 

This' assumpt ion, whi ch' de'scr i bes the second . appi i<rat ion of the DD-PT 

model* is really a*cofnb4'nati on of two' Assumpt ions : Not all children 

learn best under a single instruoitional appi*'oach. And, secondly, the 

approach whTeh wi4l maxintize the child's educational prog^^s is best 

identified f/rom the child's profile of Ability strengths and weaknesses, 

as determined by differential diagnosis. The mp^t comWn implementation 

of "the DD-PT model in this- form involves the niatchLng of instructional 

' ^ «• ' . ' 

materials and methodologies to ,ch i I dren ' s modality^ strengths (visual, 

*■ 

auditory or kinesthetic). Evi^dence supporting this assumption would 
consist of research wh4ch f nd i cates- that designing instruct*uon in accord' 
*with modality strength and weakness leads to more significant educational 
gains than does instruction which does not incorporate such ;moda I i ty- 
program) matching. - ^ . ^ - 

EVID^CE RELATING TO THE FIVE ASSUMPTIONS Of DD-PT 
In thi^ section the evidence reflating to Assumptions 2-5 as . . 

■presented; As mentioned earlier, ^sumption 1 can best be ^e'va I uated . 
by cons idering >the empirical support for the remaining four assumptions. 

^ As6urT\ptibn 2 : 

Rel iabi I i t ies of ^ 0*6- PT 'Assessment 'i nstruments ' 

^ ~ ^ ^ ^ ^ ^ ' 

A number of tests have been used Vor d If feren^t i a 1 diagnosis. Among 
thdse most frequently used are the Bender-Gesta I £ {Berber, 1938), the 
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DTVP (Fr'ostig, 1963), the ITPA (Kirk, McCarthy, & Kirk, 1968) and the 
Purdue Perceptual Motor Survey (Roach S Kephart, 1966). Other less 

• • ■- ' . •• ■ ; ^ 

frequently used tests include the Auditory Discrimination Test (Wepman, 
1973), the Benton Revise d Visual Retention Te st (Beptori, 1955),, the 
Dennis V i sua 1 - Perceptua 1 Scale (Dennis S Dennis, 1969)> the Develop- 
mental Test of VisuaT Motor integration (Beery and Buktenica, 1967), 
the G0I dman-Fr i stoe-WoiyJcock Test of Auditory D i scr nat i on (Goldman^, 
Fristoe', S'^Woodcock, 19/0), Memory for Designs (Graham ^ Dendall, I960), 
Primary Visual Motor Jest (Haworth^ 1970) and the Screening Test for 
Audi tory -Percept ion (Kimmell S W»hi , 1969). 

In suromarizing the reliabilities of these Instruments we relied on 
r^ i ews by Hammiil and Wiederholt (1973), Sedlack and Weener ' (1973) , 
Waugh (1975), and Ysseldyke (1973). In addition, test manuals were con- 
suited in an effort toobtain reliability information on DD-PT instru- 
ments that w^re not included in previous reviews. 

GeneraHy, two kinds of test reliability are reported. Test- 

retest rpViability measures the stability of scores over time; it is' 

obtained by administering the same foi;m of the teM on two occasions ^ 

3nd 'correlating the scores-^pfom each testing. Split-half reliability, 

^ measure of the internal cons i stency of 'a \est , is determined by 

f< * 
flividing the items In the test into two group^and then correlating the 

scored obtained on each half. 

Various^ authors have discussed the reliability levels conf^pred 

necessary for a test to be useful. Anastas i^- j( 1 968) proposed that test 
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rel I abi 1 i t ie# need be abovt .8Q. NummaMy (1967), on the other hand, 

suggests that the minimum reliability level should* be determined 

according to the purpose for which the test i^ employed. .For instru- 

ments used in basic researctv, minimum reliability is .80/ but for ' , 

Jnstrj^raents upon which importaht educational decisions are based, reli- 

abilities should be greater than .,90 and preferably above .95. Since 

DD'-PT test^ are employed 'essential ly for e^ducat i^a 1 decision making, 

we have adopted .85 as a minimum Tel iabi fi ty Jevel and .90 as a desired 

• « ^ , 

level--a compmmise between the two recommendations. (H^mmiJl & Wiederholt 

1973). ' • • ' ' , ' 



ITPA 



. Sedlack and Weener (1973), Waugh (1975), and Ysseldyke .(1973) ^review 
Studies which report reliabilities for the ITPA . The test-retest relia* 
b^^ity for- ITPA Total Score j>^nges. 4**^ -95^ n^pber of 

ceef f icjients was not reported in all the reviews, so the:^median value 
is not calculable. Subtest reliabilities are .even more variable, with 
Visual Sequential Memory yielding the lowest coefficients (.127.70 and . 
Auditojry Association the hrghest (.62-.'90). The 'overall median of sub- 
^test reliabili'ti^s is .71 (Sed'l^ck & Weener, ,1973). WhTle ITPA Total 
S'^ore^rel iabi 1 i t/>i s acceptaJDle, the subtest .re 1 i ab i 1 i t ies are not, 
especially with test-r^t^t i nterya 1 s^of greater than six months (Waugh, 
197$). In contrast, split-half rel iabi 1 i ties for *the ITPA are generally 
satisfactory.' AH are above'^.85, except Visual Closure which ranges 
f rbm .67 to -.83. • , ^ • 
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Overall, test-retest reliabilities the DT^jp have ranged .from 

;29 to .98 dep^i^ing upon the subtest examined and grade level of the ■ 

children tested, (HammiJI, 6 «Wlederhol t,; 197'3m Vssfel^t>r^e„ 1973^ Total ^ 

S(»re fel lability ranges frbri '.69-. 98 (median . 79 1 , and subtest reli- 

abilj\ties range from. .29 to .aO. The most reliably- subtest is Form- 
' ' ' • / r • ' \— . • . • 

Cbnstarfccy ( .67". 80*) , and .th^ least Vel ia^fele \s £ye-Han^f Coor^Jinat Ton 

As wftsh the I JPA , , sp.]jl:-ha-l f 're 1 ia^i,! i ti^s ar^ hrghier fchan test- 

retest re I 1 ab 1-1 i t i es . s Overa'l 1 , th'te *spl i t-ha1f* rel iabi l.r.ty. ^or Jota.L 

Score has renqfid from .78 to ,.,^9' .V* hrrdj vidua 1 ^sijbtests •t*afiq« \from^^5 . 

ta .96 depend ing. on thfe.'Siibtest ar>d the -agf of the chi ldren tested. -^The 

most Qonsisteat subtest i,y F^Vgere^-Ground^ ( .'9;Jv--./9^) , and t.he* ^eas^ con- • 

slstep^t i^s Spat.ial ;Relat;ons^'ips (.52t/67).' . ' , / 

♦ , * • ' f » ^ *• 

■ - , ^ • . . . . - ^ / • ' ' ' 

I. ' - * * * . *. » - -r ( ^ 

. ' ^ . t • . *> ^ • 

% , *' » . • , * . 

Other Visual Tests . ^ ' ' ; ' ' * • 

^ — ^* ^ ;v : 'V ; . ^ ' * ' [ ' ' r ' 

Of the seven oth^er "predominantly vlsai»^' percept iOA'^t^ 
f led -by \s5^1d.yke (1973) cm by .us , '^fh'fe ^urxiue . y'iel ded the.high€fst test'-- 
retest re 1 j ab 1 1 1 ty, QO^f f i c lent ^ ( .^95) . >he* Memory, f'pr Oesjgps Xmed ian « 
.87) and -the Bentpn. (.85) ajso met.thfe rhi'nimum ^andard, Tbe* remB?ning 
riiSit run^nts ei ther .fj^l 1 below the m4n ipufn .reli abi 1 i ty level: Ch i ^ago 

J — * ^ . * - '-^ ''v . • . 

Te^t of Visual Pi scr iminat iom ( . 35' .68) , DeveVppmen.tal' Test of Vi^s-u^l- 
Motor Integration (median ,83l and ^the Primary .VisuaPMotor Test (.82),, 
or failed to report ahy rel iabi 1 i ty** leye 1 ( Pennj^ Visuc^-Perc^ptua] 
Scale) .-^ Again, spl it-half reliaftrUties tended to^ be higher*than test- 
kVetest . • " * . 
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Other Auditory Tests ' ^ ' ' • ' 

» ■ > - ^ ■ ' , . 

Sjnce we could locate no reviews of the re T iab i ) i ty ' of auditoi^y 

perceptual tests, we examined selected test manual's. Jwo of thre« tests 

which. focus on auditory perception yielded acceptable re 1 i abi U t ies : 

the Auditory Discrimination Test (.9'f)^a^4 the- Goldman (.81 -.87).- The 

third. instruRpfent, the Screen i ng Test for Auditory Perception , reported 

no rel iabi 1 r^ty est imates. ' ^ 

Summary of Rel iabi I i ty Evidence ' « ' ' 

Although split-half reliabilities are* general ly within the accept- 
able range, we must concur with Hammi 1 1 and Wiederholt (1973) ^that the 
test-retest reliabilities of most 'dD-PT instruments are unacceptable. 
Possible except ions ' include the Auditory D i sc;r imi nat ion Test , Gol dmati , 
Memory for Designs and Benton. Oqly the Auditory Discrimination Test 
and the Purdue P^<i^&aptua1 Motor Survey report test-retest r6j iabi 1 i t/res ^ 
above .99. The la^tter estifnate'is bas^ on only one study which employed 
30 children tested at a one week interval. 

Low rest re I iabj 1 i.t ies cannot be taken casually. Sedlack and . 
Weener (197^3) drariat i ze ^tlie consequences of the "r = .71" coefficient 
of the ITPA subtests: 

Supposfe^that the bottom 30 percent of the f i rst'g'raders in a 
school is selected* for a special remediation progtam based on their 
September score on a" particular ITPA subtest; how many pf this 
. group ^would be, selected for the program based on retejting five ^ 
months' later in February? Sixty-three percent of the groupie lected 



20 



4 



• '\ / . ' DD-PT: A Critical .Appraisal 

* * ' * ^ V 

in September .would alsfc be ^felected in the February ■ test i ng , but 
37 percent diagKpsed .as ''Special" in September would be classified 
as^ "regul ar" in the February testing. More than on6 out of three 
of the' judgments made 6f the firs^t testing would be considered 
errors'^^^Nlie basis oft the retest which correlates .70 (p- 117) 
The Tjgl iabi 1 i t ies assocTated with many of the po'pular DD-PT in- 
struments a re/ too low to justify confidence In these measures. 'While 

♦ 

it is,p^ossible that isolated subtests may be mor.e reliable for specific 
populations, it has yet to be 'demons t rated . - 

^ , " • , Assumption 3* ' 

Validity of Test Results 

Validity involves the extent to which a test mea^sures what if is 

^intended to measure. Research related to DD-PT for each type of validity 
/ • 

described under Assufi^tion 3 is discussed below. 

< ^ 

Concurrent Criterion Validity * » 

Concu^rrent criterion validity is studied by correJating peVformance 



^or^^wo or ijiore tests which were given at approximately the same time. A 



om^w 

test is considered to be concurrently valid*if it is highly related to 

other criterion measures to which, in the^r^- it jhoujd be related. Since 
• * • * 

DD-PT tests- are assumed to measure abilities that are crucial f<5r academic 

^ "» . . • 

success*, the "other cri ter ion' measures" used to determine their con- 
current criterion A/aJidity are measures of academic achfevement. 

m 

To evaluate the correlational evicjence, a criterion of acceptability 
fiiust be .estab^] ished. Mer^ statistical significance is not sufficient 
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evidence for validity. Any size corref^tion, no matter how small, can 
be statistically significant if a large ^rfough sample is employed. The 
guidelines for determining how large cor rel at i^ons must be to satisfy 
validity requirements are based upon recocnmendations by ^Guilford (1956), 
and tarrett (195^): a correlation coefficient of .35 is set as the 
minimum acceptable cut off 0oint as evidenceof adequate criterion vali- 
dity, ^while a coefficient of .30 is considered marginally useful. In 
examining the evidence on validity it is important to consider those 

studies that control for extraneous variables (e.g., intelligence) which 

* 

spuriously inflate correltaions between specific ability meas^ures and 

achievement. We have tried to report"separately studies in which IQ . 

was controlled. A discussion of this problem is presented in the section 

f 

summarizing the validity research. 

The strategy in summarizjT>g validity studies was to consider first . 
the most comprehensive reviews in each area (psychol ingui st ic, visual 
perception, and auditory perception), and subsequently to examine studies 
which were not included in the more extensive reviews. In most studies 
reading achievement was the criterion measu/e, with arithmetic, spelling, 
and science achievement examined less frequent I y . Correlations between 
DD-^T^ssessments and i n te I I i gencie and other perceptual motor tests are 



considered \n the section on construct validity. 

w * 

Psychol ingui St ic abilities . Five reviewers focus on the relation- 
^hip between academic achievement and the 4TPA (Haring & Bateman, 1977; 
Larsen & Hammi I I , 1975; Newcomer & Hammill, 1975; Proger et al., 1973; 
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and Sedl^k & Weener, 1973)- rNewcomer and Harrwnl 1 1 ' s review is the most 
comprehensive, reporting 1 1 52* ^eparate correlation coefficients taken 
from Ik studi«6 (see Taltl^ 1). 'They located 820 correlations between * * 
I TPA scores and reading performance. Considering the 12 I t^A^ subtests 
and Total^core, only Auditory Association, Grammatic Closurts, Sound 

Blending and*Total Score showed median correlations equa] to gr in, excess 

pi. . 

of .35. "The other subtests., inclgding all those measuring visual 
processing skills, yielded coefficients which are either not ^statisti- 
cally significant or are so low^s to have little practical value" 
(Newcomer & Hammill, 1975, P- 73^) « In the five studies w^ch partial led 



Insert Table 1 a^oi/t here 



out intelligence, only Grammatic Closure (r « .38) survived as a useful 
predictor of reading achievement, A total of 178 correlations were 
reported between TTPA performance and speinh^*.' Again, on! y^ Grammat 1 c' 
Closure yielded an adequate correlation (.^1), and even it failed to 
mee/^cr i ter ion in the one study which controlled for intelligence. .Of 
the 15^ correlations between I TPA scores and arithmetic performanc^, 
only Grammatic Closure, Auditory Association and Total, Score achieved y 
correlatj^^ps above .35. In the one study which controlled for intelli- 
gence no correlations reached the minimum criterion. 

In examining the four other reviews of the I TPA onl^ two additional 
, studies relating to concurrent validity were found. Primary sources were 
consulted in b^j|^ of those cases. Lovel 1 and Gorton (1968)" reported 
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correlations of .^8 ajjfl*^.21 between ITPA Total Score and reading age -for 
"backward" and normaf readers, respectively. 'X^ey did not report results 
for ITPA ^subtests and reading achievement. Cicirelli, Granger, Schen¥nel,' ^ 
Cooper, and Holthouse (1970 found that Auditory Reception, Apditory Assoc!- 
ation, Grammatic Closure, and Total Score were most highly correlated with 
scores on the Metropolitan Readiness Test (MRT) , r * 60. 

Results of i nvest i gations on -the concur*rent criterion validity of 
^ the I TPA indicate th^t while individual investigators sometimes reported 
satisfactory validity coefficients the preponderant finding (Newcomer & 
Hammi 1 1 , 1975) is that onjy Grammatic Closure, Sound Blending, Auditory 
Association and the Total Score are useful concurrent correlates 'of 
. achievement. Of these ,' on 1 y Grammatic Closure achieved concurrent vali- 
dity when investigations controlled for IQ. 

Visual perception . In this section evidence is presented on the ♦ 

S 

^ ^ ^ 

concurrent validity of several tests of visual perception (-e.g., the DtV P ) , 
as well as on specific visual perceptual abilities as measured by dif- 
ferent instruments. 

Deve lopm^tal test of visual perception . Nine studies investi- 
gating the relation between performance on the DTVP and academic perfor-j^ 
mance were reviewed by Hammi 1 1 and Wfederholt (1973) and Larsen and Hammi 11 
(1975)- These studies reported a total of 20^ correlation coefficients. 
- A summary of those ,re*sul ts , reported by subtest, appea'rs in Table 2. 
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All subtests except Eye-Hand Coordination aue useful estimates of 
arithmetic-performance. With respect to reading, however, no DTVPy 
subtest is concur rerii ly valid. The DTVP .Tota 1 Score may be more highly 
correlated with reading Bchieverftent at lower grade levels. Based. on 
the correlations from five studies summarized , in Hammill and W^derholt's 
earlier revi^§w-4-l973) , the average correlation between reading achieve- 
ment and DTVP Total Score was ,39 for first graders, .3^ for the second 
gracjers, and .19 for thiVd graders. Thus, concurrent validity of the 
DTVP may be dependent upon the ages and experiences, of the children 
tested. 



Other visual perceptuaL tests . - ,Larsen -and Hammi 1 P( 1975) report 
the results of 11 studies us/ng the Bender-Gestal t , 12* studies using Birch 



Belmont-like assessments, six studies using subtest* of the Wechsler 

Intelligence Scales for.Chirdren ( ^ISC ) , and five using the matching 

subtest of the fIRT (see Table 2)\ These tests appear to hold little or 
m ^ # 

no promise as concurrej^t estimates of either reading or arithmetic 
achiervement. 

Specific visual percep-tual -abi 1 it ies . - Larsen and Hammi 1 1 (1975) 
summarized the relationships between academi c .performance (col 1 apse^*"^^ 
apros^ redding, spelling^ arithmetic, and readiness) and four specific 
visual perceptual abilities as measured by a variety of instruments 
( Chicagg^T^st of VisuaT Discrimination , MRT, Perceptual Achievement Forms 
Test , yfSC , Memory for Designs , Bi rch-Belmont- 1 i ke Instruments, Bender- 
Gestal t , ITPA 6 the DTVP ) . A number of standardized tests served as 
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achievement .measures (e. g. / Metropol i tan AchievemeYit Test ^wi the^ Wide 

^ - • - 

Range Achievement Test ); Specific abilities considered were visual 
discrimination, visual memory, spatial relations, af|d auditory-visual 
integration. They reviewed 60 studies that included 600 individual 
correlation coefficients (see Table 3K Inspection of the correlatTons 
shows r^ather clearly that -none of these visual perceptual abilities were 
a valid indicato^_of academic achievement. 

^ --^ . - 

Jpsert, Table 3 about here 



Thirteen studies not appeari-ng in Larsen and HammilPs review were 

located in reviews by Silverston and Deichman (1975), Ysseldyke (1973), 

Hammill (1972), and Sabatino (1973), and by an additional library search. 

^ . 1 

We obtained primary sources for seven of these studies. For these seven, 

-'"^ "^^"^ ~ ^ 

median correlation coefficients were computed between visual abilities 

(vis4^1 discrimination, aud io-v i sua T i n tegrat i on ,» copy rng ^d visual - 

memory) and achievement (comprehension, Vocabulary, arft^etic, ^j*++ing, 

and writing). Us^ng the .35 cutoff, visual discrimination (^2 coefficients,) 

evidenced concjurrenf validity with regard to reading, comprehension (but 

not word recognition), spelling and writing; copying subtests ^(5 coeffi- 
* 

cients) appeared to be val i d 'est imates of reading comprehension and writing 
ac^\ievement ; audio-visual integrafipn 'subtests (l6 g^eff icie^^ts) werej^ 
val id est imf tes 'for reading comprehension. WhiJ^ these stud ies • reported 
correlations somewhat higher than those reviewed by Larsen ^nd Hammill 
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(1975). it is clear that .their addition to the 60 studies contained in 
that review would not raise the median correlations enough to satisfy 
validity requi rem€nts. Moreover , none of the seven studies^ partial t'fed 

out IQ. " • . ^ ' \ , 

* ' > • « 

We were unable to procure primary sources for the remaining $ix 

2 ' * ■ • ^ 

studies. According to other reyTewers, however, the$e studies tended 

* ^ % • 

tp report coefficients that would not satRfy minimum validity standards. 
• > Auditory perception . Hammill (1972) ^ Hanomiri and Larsen (l97^b), 
Haring and Bateman (1977), Sabatino (1973), and Silverston and Deichman 
(1975) Have reviewed studies of the^ relationship between auditory abi- 
lities and academic achievement. Of these, Hammill and Lars^ provided 
Fhe rrtost comprehensive account, reviewing ^0 studies that contained a 
total oT 279 correlation coefficients. Since four of- these studies-^we^ 

long i tud i-nal , they will be cbnsicfered in the section on predicti've ^ 

. w \ • . ' ' 
-validity, , » . , 

V ' ' ^' , . 

V ^ * . * 

Auditory perception tests . Of the frequently used auditory 

^' ^ 

perception tests ( AOditory Discrimination Test , the ,Bi rch-Be Imont , Detroi t 

Attention for Re UteS' Sy 1 lab les , JTPA: Auditory Sequential Memory, 

■ " ' ^ 

• * - ' \ ' 

Roswe 1 l-Cha 1 1 : - Aud i tory Blending Test, S eashore , and W ISC: Digit Span) 

only two were ct)ri*e 1 if t^rf greater than .35'with reading: Ro^^fl-Chalt 

with general r.eading a^^ BTpch-BelmOnt* v^i th comprehension (Hammill & 

Laj^sflm, 197^b). In neither case ^as intel Hgerrce partial led out. 

^ Spegi fTg>l^jdi tory perceptual abilities . Median correljiti^ns^ 

bi 
% 



between five auditpry abilities (atfd i tory-v i sua j^rftegrat i on , sound 
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blending,' auditory memory, phonetic auditory discrimination and non- 

f 

'phonetic auditory discrimination) and general reading ability were 
reported by Hammi 1 1 and Larsen (I97^b),. When correlation^ were corrected 
for intelligence Cas was 'done Jn 63 of the coefficients) no auditory 
abilities provided useful concurrent es-tirnat^s of general reading skill. 
This was also true when the correlations were broken down by grade 
level. When intel 1 igence was not" par t i a 1 led out, sound blending was 

rrelated above the .35 cutoff with overall reading achievemerrt-. Table 
k reportk a breakdown of the relationship between the five auditory 
abilities and two reading coraponents: word recognit;ion and comprehension 
As can be seen, only aud i tory-*vi sual ^ir^tegr^t ion achieved a median corre- 
Nation of greater than .35 with a' reading subskill. 

# 

# 1 * ^ ♦ , ^ 

* fc . , . . » 

'•«' Insert Tatxle k about 'here * 



^ ^ , ^ .....^ ^ 

Only'three studies were located which did not appear in Hammi 1 1 and 
Larsen Cl97^b). .Lovell and (i^rton (1968) reported correlations of .38 
and j^} between auditory discrimination and reading for "backward" and 

normal readers, respectively. In 1970, lun\f and Carsen (described in 
• * 

Hari.hg & Bateman, 1977) reported correlattdns of .5^ and .58 betweien 

two rhythm test^ and. reading. These same tests correlated only .03 and 

* « . 

.07 with arithmetic. In neither of these studies was int^el 1 igence 
partialled out. Finally, Sabatirro reported that auditory integration 
(blendi^vg^as been shown by Al sh^n ( 1965), to "predict reading achieve- 
CPent in restricted populations" (1973, 65.). 
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Taken togetl^, stales investigating the re^W^ionshlp between 
.measles of aud i tor-y* perceptua 1 abilities aA^^cadewic achi^ement fail 
to demonstrate the concurrent validity of the auditory measures. Lack 
of evidence for concurrent validity isr particularly striking within 
those studies that control for IQ. . 

Summary of concurrent validity . Results of this^ review indTcate 
* that the I JPA has not proven to be concurrently valid with respect to 
academic achievement; only Gr^jrnnatic Closure and the Tota-l^ Score corre- 
late satisfactorily with academic skills when IQ is controlled. Visual 
perception as measured by the DTVP may adequately predict arithmetic but 
not reading performance. Other visual perceptual tests produce similarly 
disappointing results. Likewise,. i1r>struments which assess audi tory^ 
perception tend, not to serve as concurrently val idestimates of reading 
or arithrp6tic achievement. This picture remains consistent when one 
consider> specific visualand auditory abilities across tests. Except 
for, sound b.lending abrlity, which correlated with reading achievement 
at the secondary level, ^nd audio-visual integration, whicb correlated 
with reading comprehension,, the nine specific abilities studied are not 
valid estimator^ of academic achievement. The^exceptions may also be 
suspect since IQ was not partialled out of the corre*lationi. ^ It is 
^^ff icult to escape the general conclusion that measureirfent devices 
traditionally used in differential diagnosis lack concurrent criterion 
va^dity with respect to academic skills. 
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Predictive Criterion Validity * * 

^ WhTle concurrent validity Js examined^by correla'tjng attility and 

achievement tests given at the same;point in time, pred ict i ve -vert i d i ty 

is determined by torrelating psychological abilities measured at one 

poJnt in time, (often ki n^ergar tenji with later "academic achievement. 
♦ 

CoVrel^tipfts above the .35 criterion vvould'raise confidence in the pre- 
dictive vali^ty of abi 1 i ty measures . . Barrett (1965a), Hammill and 
Larsen (l97^b), Larsen and Hammi 1 U' ( 1 975) , Newcomer and Harrwni 1 1' (1975) , 
Sedlack and Weener .(1973), fhd SUVerston and' Deichman (1975) together 
examined 29 studies of^pred i ct i ve va 1 id i ty. The interval between ability 
and achievement testing in these studies ranged from three months to 
three years. 

3 • . 

Psychol i ngu i St i c abilities . Four studies weVe revi^w^d by Newcomer 
and Hammill (1975) in which I TPA performance was correlated with achieve- 
ment measures ^aketi at least hine rnonth^ later. In general, f TPA 

^ Total Sco/e was a useful predicto;r of general achievement'. 

^ As for the ITPA subtests, Audj>^ry Association consistently predicted 

heading achievement Across studied. Failure to partial out iQ may account 
for this finding, given that. Audi tory Association appeared to be a con- 
Curreat-ly val'id estimate of^^rfing except in studies which cor\trolled 
for IQ- The picture of predictive validity i)5 unclear for other I TPA 
subtests and achievement measures, •^liesults from the ^a'r^ouB studies 

• are in conflict. Hi fshoren ,p969) found six of nine subtests predictive -> 
of Spelling performance; but th*is Was not replicated in the West in§hoiise 
(1969) study. Sjmtlar disparities have been noted when arithmetic was 
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tfie object of precf i<^t i2>n. Hirshoren reported that eve/y/ ITPA subtest 
us"elivny predicted arithmetic achievement; Mueller , on the other 

hand, fourvd no significant predictors airong the subtests. In none of thfe 

studies was the contribution of intel ligerlce cont^lled. This, along 

f / 

with the fac^ that 'so few studies have been performed tnake it extremely 
diTficult to evaluate the predictive vali^dity of various ITPA subtests- 

Visual pe rcep t i on . Five studies which investigated the predic- 
tive validity of the Bender for academic achievement appeared in reviews 
by Larsen and Hammi 1 1 . (1975) and Newcomer and Hammi 1 1 (1975). Only 
reading comprehension had five or more reported correlations with th^' 
Bender . These ranged from .17 to .51 with a median of .28. The 15 
coefficients presented for a 1 1 t^yp^s of achievement ranged from .16 
to .51, with/a median of .33- It appeared that ^he Bend|gr predicted 
arithmeH^and sjielUng performemces better than it did reading. In, 
only one of the^e investigations was intelligence partial led out, Keogh 
(1965) reported that correlations between the Bender and reading achieve- 
merrt'became insignificant when thi.s was done. Keogh expressed the 
problems of predrctive validity for the Bender . ^^^^ 
^ Cutoff scores defining good bender performance at kindergarten 

or third grade clearly identified successful' readers; poor Bender 
performance at either grade was nondef infitive for individual 
' * prediction.', i .al though correlations between the Bender and reading 
criteria were of statistical s igrri f i cance, magn i tudes were too 
small to al low conf r3ent" indfvldual prediction of reading from 

<: • • . ' 
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th^^ Bender . Individual design i nterpretat ion . , . f 6? differential ^ 
diagnosis [was] not supported. (1965; p. 83) * . ^ ^ 

: ;-/^lghteen studies^ involving 112 correlations pert a ijTjrrf" to the^.^ 
pre/ic'tive validity of roi sceVl aneous visual perceptual tests were 
'inQluded in the reviews by Barretj: (I965a), Larsen and'Harmmill (1975), 
Newcomer and HammiH (1S75)V and Silversjon and Deichman (1975).' Table 
5 presents our calculation of median correlations from'these Studied 
between four visual abilities (visual discrimination, auditory-visual , ,^ 
integration, gross and fine motor movement, and laterality and body 
^image) and various achievement ard^s. The only correlation that meets 



Insert Table 5 about here 



va'li^ty standards" is between visual d i,scri,minat ion and read i ng, compre- 
hension. Since there were only thnee reported correlations "between 
auditory-visual i ntjegra't Ion and^academic performance, it is difficult 

to evaluate the predi,ctiVe validity of this ability. Intelligence was 
, * * 

not partial l^d out of these correlations. ^ ^ ' • 

Auditory perception . From reviews by Hammi 1 1 and Larsen (I97^b), 
La^rs^fi^nd Hamm'i fl (1975),* and Newcomer and Hammi 1 1 (1975), tour primary 
sources^ were located which dealt with the pred»ictive validity of 
auditory perceptual abilities for later achievement. A total of 26 
sepai^ate correlations yielded a median correlation of .38, Only the 
relationship of auditory blending and auditory discrimination to reading 
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comprehjension were exatninec^^ enough analyses to be summaAi zed 'sepa- 

rately. Mediar\ correlations were .50 (8 coefficients) and ; 37 (5 eoef- 

ficients) respectively. The highest correlations were reported for 

•reading and the lowest for writing (although the latter is Ms^^on 

i 

few coefficients). In^ general ,^these studies suggest th^t * 

audi tprya^i Ti ty fneasures may have satLi /factory predictive va^dity. 

^^.^ ' " * , . = 

However, some caution should be exercised since inXe^ligence was not 

*^ 

partiallecJ out in any of the studies. 

Suntnary of pred4ctive validity . ITPA Total Score, certain . 

!TPA subtests, visual d i sgr imi nat i on , auditory discrimination and audi- 
, tory blending a41 appear to ^correlated with various academic skills 

beyond the .35 level^ It is difficult, however, to draw firm conclusions 

regarding the pre^ctive yaUdi^ty of- various DD-PT measures since so few 

longitudinal studfes have investigated the relationship between specific 

abilities .and specific academic skills. 

Caution is warranted in interpreting the xprrelat ion coefficients 

presentedNn the concurrent and pred'ictive critejs.iop validity secti^&qs. 

Congelation coefficients between tests can be influenced by many factors, 
-^ot aTl of which'are' related t* the true relationship between the 

measures, (Proger ei al., 1973; Ysseldyke, 1973). Spuriously low or 

high correlations could result from sclera l""of^ he following conditions. 

First, there -^tends to be much comrnon variation.jn correlation coefficients. 

A specific ability may appear to correlate highly with reading achievement, 

but this correlation could be the result of some othej^^^ factor that is 
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being inadvertently measured by the ability test. Since i nte 1 1 i gencc"^ 

appears to be corr'e-lated 'substant ial ly , both with reading and with 

underlying perceptua 1 -abi l i t ie^ , the correlation between reading and ^ 

percept\^l ability could be due .to the commonf exponent of intelligence. 

"Second, correlations ijetween an ability test and a criterion could be 

low not because the abrpfty te^t is invalid, but,b^^se the criterion 

to which it is compared is itself invalid. This should not be a major 

problenr for the studies reported in this section, "since tfie criteria are 

generally measures of academic achievement.* Third, coefficients are 

les^s'' rel i abl e when based on small samples. With small samples reported 

correlations may be spuriously high, or^drasticarl ly underestimated. ^ 

^ General ly^>- informat ion on sample size was omitted in the reviews. In 

.addition, correlations tenti to be deflated wheo samples are drawn from 

highly homogenous groups with a restricted range of abilit7. Agafn, the 

reviews tended not to supply specific information on the characteristics 

of the research population and sampling proC€idures. - For these reasons • 

• . 

we believe that examinatiort of several studies gives a more accurate 

f 

picture of DD-PT instrument validity than does any single^study by 

i • 

itself. Finally, the val idity of arty te'st-^ is_l imked^by j ts rel iabi lity. 
This fact is part i c'ular ly- problemat ic f or 'the DD-PT model since many of ^ 
the test instruments^suf fer significant reliability deficiencies as 
noted earlier. Without satisfactory rpl i abi 1 i t ies , one cannot hope to 
demonstrate satisfactory validity. ' / 
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Diagnostic Val idi tv 

The diagnostic va^9fty of a test \s its ability to discriminate 
be tweerV^^g roups which are known to differ on some other variable, such 
as reading ski 1 1 / presence of a learning disability, race ,^ or socio* 
.economic status. Typically, th^ diagno'stic validity of ability tests 
'has been* studied by detercnining whether or not an ability test differ- 
ent iates , be tv^en good readers and poor readers. Diagnostic validity 
is an important consideration because many of the DD-PT tests and 
sjjbtests jare used to classify children as educable mentally retarded, 
learning disabled,^ neurological ly impaired, educationally handicapped, 
etc. SucK classifications can have rather dramatic efjects^on a 



child's life, possibly disqualifying the child from receiving special 

i n 



education services or, atternat i vel y , resulting iti placement in a 



restrictive setting, e.g., a special class. 

Psychol ingui st>ic abilities . Three reviews of diagnostic validity 
concern tbemsel ves ^xcl us i ve 1 y with the ITPA (Newcom^^ & Hammi 1 1 , J975; 
Proger et al., 1973; and Sedlack^ & Weener, 1973). Newcomer and Hammi 1 1 
(1975) summarized 2^ studies that attempted to determine whether ITPA 
performance d i St i ngu i shed between good and poor readers^ Table 6 
summarizes the percentage of analys^§ in which subtests successfully 
differentiated groups of readers. la the 1^ studies whfch did not 
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control^ for intelligence, only Grammatic Closure and Sound 'Blending 
were sutcessf^l in differentiating between groups of readers in (Dore 
than one-half -of the studies. In the studies that control le<i for intelli- 
gence no subtest differentiated between groups more than of . the time. 

Proger et al. (1973) reveiwed two'studies which were not reported 
in the other reviews (Dugger^ Gaskins / 1971 ) • Both stud ies"- exami ned 
the power of the ITPA to distinguish good a/vcl poor reader^. Neither study 
reported significant differences between good and poor readers on any 
portion of the ITPA . In a recent study Larsen, Rogers, and Sowell (1976) 
compared learning disabled children who also had jading deficits with 
non handicapped' normal readers'^n three subtests of the ITPA (Visual and 
Auditory Sequential Memory and Sound Eltending). They could detect no 
differences between groups. 

Vi^sual perceptu^^d^l^i 1 ities . Studies which attempted to assess 

the diagnostic validity of various measures of visual perception have 

• \. • 

been identified by Hammill (1972), Hammill and Larsen (I97i*b), Larsen 

% • ; 

and Haumill (1975), Sabatino ( 1973) S.i 1 verston and Deichman (1975), 
and Ysseldyke (1975). In all, 16 studies^ were located and consulted.^ 
as primary sources (see Table 7)- . ^ 

Of the 37 comparisons which attempted to d i fferent i ate* between 
good and poorjeaders, 19 (ST^) wera. successful. This p^^'rcentage is 
reduced to in the studies which controlled for intelligence. 
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Analysis by subskill revealeji that the majority of significant differ- 

ences are accounted' for by auditory-visual integration measures. Overall, 

neither v i sua 1 _d I scr imi nat i on , vi sual* memory, nor ,mi seel laneous ^isual^ 

ability measures distinguished between good arid poor readers more than 

♦ 

36% of the''tirT>e. . * 

Auditory perception . Diagnostic validity of auditory ability tests 

has been reviewed by Hammill ( 1 972) , , Harrfni 1 1 and Larsen, (l 97^b) , and 

Sabatino (1973). Many of the studies were not described in detail in 

these revie>vs; thus, primary sources y«re consulted whenever possible. 

8 

^ Fifteen studies examined the diagnostic validity of ^various 
auditory abilities for di f fereot i at rng^ood* f rom poor readers. Overall, 
88% of the auditory perception measuresr (35/l'*0) showed significant * 
differences between groups of readers. €ven with intelligence controlled, 

•six of eight measures (75%) were significant (see Ta^ 7). Larsen 

*^ 

et.aK, (1976) was the single study which attempted to verify the diag- 

** ' 

nostic validity of an auditory test on a population other than'good^ 
and poor ' readers . When they compared learning disabled and normal chil- 
dren on the Auit4 tory i scr i mi nat i on Test they found no difference's. ^ 
Summary of diagnostic val idity . Neither subtests of the 1TPA nor 
most visual perceptual abi^i t i es- Uxcept audi tdry-vi sual integration) 

possess Satisfactory diagnostic validity for reading. By contrast, 
« <^ 

auditory measures demonstrate good diagnostic validity for reading. ^ 
Many instruments frequently used, in differential diagnosis have yet ^to 
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be examined for diagnostic validity in- academic achlfei^ment areas other 



than readiag. Except for. auditory tests, .the diagnostic validity of 
differential diagnostic instrument's Is inridequate. 



. Construct Val irfi ty " 

The construct validity of a test can be vievfed as the degree to 
which the test delineates the dimensions of the theoret i ca 1 , mode 1 on 
which it is based. Progenet al., (1973) describe a construct as an 
abstract variable, delineated by an individual theoretician, which 
represehts an hypothesis of how a variety of behaviors will correlate 
with one another. Evidence rj&lating to other types of Validity (e.g., 
concurrent) are relevant %p const/uct validity. Howe'ver, the present 
discussion of construct validity' is limited to factor analytic studies 
that describe the psVchblog i ca 1 dimensions of a test, and to concurrent 
cr i terion* val id! ty studies which relate other hypothet^ca^^const ructs, 
such as intelligence and perceptual motor abi 1 i ty, to the test in question. 

" ITPA. The ITPA is composed of 12 subtests which attempt >o assess 

/ 

language. performance at two ^eyejs (representational and automat i c) , J:wo 
channels (aud i tory- voca 1 and visual -H)tor) , and three processes (reception 
association, and expression). \i the theoretical model underVymg the % 
ITPA is valid, then factor ana 1 yt i c studies should distinguish performance 
along the levels, channels, and processes. Factor analytic studies of 
the ITPA have been reviewed by Proger et al. (1573). Sedlack and ^ener 
• (1973), -Meyers (1969)^ and Waugh {J975). 
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Conclusions regarding the, cons truct va f i d i ty of the ITPA differ 
* depending upon how individual ijivest igators conduced the4 r factor 
analyses. Early studies e^camined factor groupings of just the ITPA 
subtest's without employing external criteria.. Proger yT973) sumnarized 
nine such studies as indicating that the factor analytic structure of 
*t the ITPA is much simpler than the mode l' orv wh i ct^ it is based. Besides 
a general linguistic factor' that is similar to a general intelligence 
factor, only the channels dimension seemed to be clearly dfstinct. 
Sedlack and Weener (1973)* who consider 20 factor analytic studies, are 
even less positive: ' " * , 

c ^ 

The tentative factors that have been identified in factor analytic 
studies offer scant Support fbr the channe 1 - 1 eve 1 -process model on 
wfiich Ihe ITPA^ is tesed....it is difficult to say what- kind of 
factor structure one would predict, based upon the theoretical, 
^ ^del of the ITPA . . . [si nee J factors which v^rould honor process 

distinctions would cut across channels and levels, etc. (p. 12,^) 
Vaugh (1975) reached an opposite conclusion, that there was indeed empi r- 
ical support for the ITPA model * Her review included three recent studies 
which employed not only, the ITPA but other reference tests designed to 
measure the same trarts as the I TPA . 

Waugh*s analysis i s suppor'ted by Newcomer, Hare, Hammi 1 1 , and 
McGettigan (197^) > a primary source not included in previous reviews. 
They factor analyzed the ITPA wi th twenty criterion tests judged to ^ 
parallel the functions measured by the ITPA , and found ten factors 
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accounting for 66^ of the total variance. Accordin'g to these data, the 
JTPA subtests appear to measure independent abilities wrth the exception 
of Visual Sequential Memory, Visual Reception and Aurfitory Reception. ^ 
They also found support for. the level and process 'dimensions, but not ^ 
for visual and auditory channels. If the "visual" tests do not Inea^ure 
a unique function, this could explain why the auditory tests of* the ITgA . 
relate higher thar? do the visual test to measures of ''academic performance. 

A test's construct validity can also be studied by examining the 
pattern of correlations between it and other "theoretically related" 
performances. For»example, if ITPA subtests correlate highly wi^h <■ 
criterion measures to which they in theory should correlate (e.g., Audi- 

» 

tory Reception with reading comprehension), yet have near zero correla- 
tions with other criterion measures frorp which- they should in theory 
be independent (e.g.. Auditory Reception with arithmetic comput^ti 
then thi5 would be interpreted as Support fx>r the constructs that the 
subtests claim to measure (Campbell S pfske, 1959)^. Sedlack and Weene.r 
(1973), reviewing studies that foUowecf this strat'^gy, conclude that ' 
"findings from each of these studies were quite ml/ced, and none showed 



exjfect-ed'relat ionships (or nvn-re lat ionshi ps) between the criterion 
variables and the ifPA" (p. 123). 1^ ^ ^ ' > ^ 

Proger et a). (1973}. reported data fr.om Ik st^uci-ies on -th^ relation- 
ships, of various measures of intelligence and language scores to the 
ITPA. Twentyfiye correlations between intelligence subtests apd the " ^ 
ITPA subtests ranged from .lAto .83, with a median of .50. Thfs supports 
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th^ g^veral conclusipn of other reviewers that intelligence may^account 
for \ Viy^e |^i;tion o^ the variance in tKe scores^f *the ITPA . The 
corrsisteort relationship between the ITPA and measures of, WlteJ[ I igence ^ 

■ ^' 

nte 



skills, since in|#)^k of these studies intelligence was noV P^r^^'ial led 



poSes a ser ious. problem for the studies relating the ITPA to. academic* 

out. » . ' : • 

DTj/P* . Since the DTVP . ^ composed of five subtests whidh ar^ wntendecj 
to tap distinct aspects of^isual perception, this instrument's (^on^jjjlft^^ 
val idi ty would be supported by factor analytic results which indicated , • 
five factor groupings. Hammill and Wiederholt (1973) reviewed construct 
validity studies on the DTVP. They report "that nine studies rai led t<^ 
find five separate perceptual factors in^ the •DTVP-, ^'Jp -facL^_SLeven^tudies 
^ound only arte' factor, while the Qther two S-tudies found onl^ two" (p/^^l) 
Hamrai 1 1 and Wiederholt also rll^ort fourteen studies vA^ch correVate^l IQ 
measures' to the DTVP. "^hese coeff i cients . ranged frqm to .59, with 
a median tit ,33. Cor>rela t iof! between the- DTVP and "^t ^Bendar are reported 

J ■ •■ • • 

in three sfuxihes. yi^l^ing 'coeff icients of .75, -52 and .6%. Results, 

% * ' ' . 

• ^ n * 

A • , ^ . 

in general, do rfot'show the patterns of high'^^l low correlations that- 
ara needed for construct validation, and may t>e accounted for ^y a^thiVd' 
factor common 't«> each measure, rfamely intelligent. ^ ^ ' ^ 

• " ' • • , - 

tests. Sabatino (1973) reviews factor analytic studies' 



a nf^er ^ ^udi tory ability tests. Although not reporting the 

^^^^^ r\ ^ . * 



specific tests '^sed, he cone 1 udes< 

Review of- the facti^ial^ work to datej sOiggest^s that the aspects , 



of auditory perception defined as important by any given researcher 
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are simply those he selected to study. The genera 1 * lack of agree- 
ment' as to the important dimensions of auditory pefcept^ bears 
out again the compflxity of abilities, sybskilTs and skills 
present in its make-^p. (p.* 58) 
Saba'tina also reported/that for three studies, correlations of auditory 
perception with" in'^lligence hoy^reJ .around .ifO.* /^ppar«ntly, \ntr)f litt+e-^ 
research has addressed construct valTdity-of auditory perceptual 



measures. ^ 



Sammarf construct vaUji^y . Reviews on^^fconsVRjct va.Udi ty 
of -tests used to measure urpdferl^ing abi 1 i ty' provide mixed resu^.* ^* 
'''pattor analytic studies /indicate that ITPA performance is highly ^related' 
to IQ, but give?onsl<Jerable suppor^fof the leW and proc^SfcTdirrtensions 
hypothesized by The IficWeJ . In. contrast; ther« exlst^no support f^^ the 
ex^tence of f'iv^e indef^endent peceeptual abilities as sijggfsted bV the^ 
)dTV.P. * One* should bear in^mind that even if factor struclures wer^ found, 
Mt would not. mean that the test instrument is educational ly usefu-l , ^ 
e>?en that the factor structure was properly named. Indeed,, Waugh (^975)^ 
has. sugge^ed that the IIPA is misnamed and t^s really^ measure of cpgfii- 
, ti^e functioning or - i nTre li igence rather . than gf perceptual -and psycho-' 



JPl ingCijstic* ^i.^^i€s. 

* , * . ' Assumption AA: * • ^ / ' 

^ ' . ^ Tralhing Weak Abi 1 ities / = * 

According to the DD-PT rtodel', chi hdren who. have fai.l4d to develop 
adequate perdeptua 1 , motor , or psycho 1 i'ngui'st ic abilitjes will, encounter 
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serious problems in acquiring basic academic skills^ When weak abilities 
are^'j'deot if ied, they should be trailed or strent^thened lest the*^ continue 
to abstruct school progress^ ^Major ^ssump^ons inherent in this -view are 
that these skills can be trained andXliat such training will result in 

improved academic performance. "^^This section w.i 1 1 'consider the extent to 

^ ' ' ' ? ♦ . • 

which systematic training of underlying at)ilities has been successful in 

improving those ^cibf 1 i t i es . The ^effect of ability training on||academic 
achievement measures wi-H be desc^ribed in febe next section. 

A comnxjri' resecfrch par^igm ^j^racter i zes ability training investi- 
gations. First, .chi'^Tdren are identified *who perform poorly i^oth on an 

ability assessment and on an academic measure. Secon^i, some of tnese 

> 

children •are selected to form the exper imenta 1 • group and are given 
ability training; the others sferve as a cdhtrol and receive the "regu||r" 
program of instruction. Fi na 1 1 y / after a specified time has passed both 
groups of cMldren are retest^d on the -original ability test and their 
performance is compared. The amount of atjility improvement is analyzed 
as a frfnction of the two ti;eat'ment^. ^ 

r < , • 

Perceptual Motor Training ^ , ^ 

> Goodman aad Hammin^fW^-, H^llahan and Crui'ckshank (1973), Hammill 

(1972), Haninill et al. (197^), Har^ng and Bateman (1871), Keogh (197^); 

Kl^fcisius (1972), Kripphef (1973). Proger et al, (1 973) • Robi nson (19^2), 

Sabatino (1973), Sedlack ancj Werner 1 973) . and Ysseldyke (1973) have 

% « • » 

K 

all provided reviews of training in d[fferent abi 1 i ty areas. These 
reviews dl'ffer in several /espects other than the specific ability area 
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of*focus. Some concentrated on specific psychometric ability tests* and 

attempted to determine if various approaches to ability training had 

been successful in improving perf6rrf»ance or^ these specific tests (Harpfiiill 

& Ursen, *r57^a ; ' Proger et al . ; 1973; Sedlack & Weener , * 1 973) • Others 

focused on a particular tcainirag program, such as that developed by 

Frostig and Home (l96^), and recoi*^d that program's success in improving 

underlying abilities as measured by^v^rious Jnstituments C^allaharl & 

Cruickshank, 1973; Haring ^^Bat^eman, 1977; and Robinson, 197?). Other 

reviewers examined mu 1 1 i pi e pifcgrams ^nd their effects^ on a varie-ty of 

tests (Hallahan & Cruickshank, i;97T; Krei;si^;$, 1?72; Proger et al., T973; 

Sabatino, 1973;' and Ysseldyke', 1973).^ ;twi ce- have rev iewers 'attempted 

\^ ? " ' ' ^ ' 

to categorize studies on the bas i s'^of • the population stixlied (Hallahan & 

» - ■* 

Cruickshank, 1973; HammilTS Larsen, 197Aa^'>^ Another di/ference among 

_ : , . . ^ *^ - 

reviews has been the incl fha^ion ,of some authors tO- d i f ferent iate between 
well and poorly desCgned studies.*, -Final ly, so^ reyewer.s merely reported 
presence or absence of treat^^t effects, whi le ^otKers^Teported in greater 
detail how particular- trea\menti^f*f*ctea particular measures., Thp^e 
differences among reviews, a)of^:\f[^ the f act *that rtb review was compre- 
hensive, have contributed to divergent and sometimes conflicting conclu-^ 
sions regarding the degree of success enjoyeH by ability training programs 

In an atteftipt to provide? a more complete picture of the training 
studi,es, the following 3^r|tegy was ^dopt^. The' mo;5t conl^ehensrve 
reviews are reported first, followed*|by studies from other reviews which 
were not included in the more comprehensive reviews. . Pr iipary 'sources 
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were consulted Wflen reviews presented confl icting information orMacked 
.sufficient detail. Since it was impossible to secure primary sources in 
every such irvstance, it was sometimes necessary to report the studies 
as described in the review. The only studies considered Were thos^ in 
which t-raip^d and ^untrained groups were cornpared, and in which training 
focused on a psydho.log ical ability considered important for academic 
achievement. 

^ble 8 sufT¥narize5 the 'success of training for abi^lities popularized 
by DDcPT. Studies ^re classified according to the specrfic training 
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program employed and as to the adequacy of the research design. The 
- di fVerentf^t ion^etween well and poorly designed studies was not ours; 
rather, • the^were the judgments of past reviewers. ^Fbr example, to be 
'classifred as welldesigned by, Hammill et al. (197^>, a study had to 
hav^ an N > 20, coa^rol group and training for a minimum of 15 weeks. 
^Hallahan ancTCrui ckshank (1973) classified studies as well or poorly . 
^ ^desjgnecTdependihg upon the exfent to which a'study controlled (e.g. 
faridom assignment) for potential sources of bias. It is evident from 

s 

\ this table that well designed attempts to train underlying abilities 
are characterized by failure; only, 2^^ of these studies show success'.^ 
Ability training more often appeared to succeed in the poorly designed 
studies (^y. All studies considered, the overwhelming weight of this 
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research indicates that underlying abi 1 i t ies* presumed important for 
schQDl learning are rerparkaSfy , res i stjat -*e^ improvement ^hrough trainirig 
with current methods . 'Sign i fi cant abi 1 i ty^ t rai n ing effects are observed 
on only k\% of the measures.- 

The same pattern is evident for individual training programs. Of 
the studi^es rated as good, only 12.5^ of those employing frostig 
training materials report success in improving visual abilities. To 
incluide poorly designed studies and those not rated raises the success 
rat£^fc'55%, but brings j^to doubt the validity of the claim to success, 
Wei l/ifesigned studies employing Kephart-Getman procedures , show a 
success rate. Success rate rises only to 3^% when al f J^phart-Getman 
studies are included. The success rat-e with the Delacato'approach is 
0% for wfell designed studies and 7(>X for all studies. Studies employing 
misrel laneous perceptua 1-fnotor training programs show a success rate of 
only 

Psychol ingui St ic Training 

Trasnipg of psychol ingui st ic abilities tf^measured by the ITPA has 
been *sun¥nari zed b/ Hamrai l 1 and Larsen (I97^a) who cons i de rect* 39 studies 
and 280 separate comparisons of trat-ned and untrained groups. They 
categorized results training program, (i'.e:, Peabody La n<^uaqe Develop- 
ment Kit [ PDLK ] or a Selected activi'ties approach), by psychol inguistic 
ability measured, by population studied, and by deg^€e of individuali- 
zation (prescriptive vs. non- i-nd i v i dua 1 i zed , where all children w^e 
exposed to a set program). . , , 
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T^blc 9 reveals that neitiher training program ( PDLK vs. selected 
activities) produced consistently positive results,^ wi th success rates 
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generally below S0%. Similarly, results for the various populations 
studied indic^e ^hat traini^^fai led more often than not. Of the 
specific abilities subjected to .trainir^g, only verbal expression 
appeared' trainable in more than S0% of the studies. Finally, pre- 
scriptive approaches were, in general, no more effective than non- 
individualized approaches. 

Sbmmary of Ability Training * 

;# After reviewing over 100 separate ^stud ies covering a wide range of 
auditory, visual and psychol I ngu t st i c training programs, one firids llttl 

evidence to support the trainability of underlying psychological ablli^ 

*. 

'ties. f^wer than 50^ of training efforts have^ylelded dividends in 
ability growth*. This Is the case whether results are l^jmmar I ze'^d accord! 
to specific H^lning programs, to the degree of individualization, or 
to the population's studied. \y , 

. As5 unction ^B: ^ 

Effects oil Adademic Per formance ^ 

, ' ■ — <k 

The crucial test of the DD-PT Ifnodel is whether training weak 
^'abilities leads to Increased aca<iemlc success. The research paradigm 
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If) Studies which address this issue iS essentially the same as *that 
described in the previous section on ability training. The primary 
difference, of course, is that training is not evaluated on the basis 
of improved ability test^scores, but .instead on improvd^ performance 
on tests of academic functioning (ie.g., rea^><)g achievement) or some- 
times on^measures of intellectual functioning Ae.g. , the Wt^C ) . 

While Hallahan and Cruickshank (1973), Hammi\jl and WiederhoU 
(1973), Keogh (197^), Kleisius (^972), Robinson (]972), and Sedlack* 
and Weener (1973) all provide reviews of th i s. aspect of DD-PT, the 
most comprehensive reviews are tho^e by Goodman- and Hammi 1 1 (19^73), 
and Hammi 11 et al . (I9H) • . - * ^ 

These reviews cover over 100 separate investigations. In addition, 

$/ 

five studies reviewed by Keogh (197^) were not reported in sufficj^ent 
detail for inclusion in this summary and were not available as primary 
sources. These' stud ies (Coleman, 1972; Hopper, 1962; Mprgan, Note 2; 
Shearer, Note 3; and Young, Note k) , however, generally reportfed sig- 
nificant effects on some academic measures. 

" Table 10 summarizes the studies according to type of traj^Jng* 
program Te.g., Kephar t-Getman , Frostig, etc.), type of outcome measure 
(e.g-., readiness-, reading, IQ, etc.), quality of research design as 
judged by the reviewers, the number of measures and thg percent; of 
these measures on which t'Pained groups outperformed untrained controls 

« 

(i.e., percent successes). 
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Insert Table 10 about here 



Considering all studies together, ability trained'groups surpassed 
control groups on only 38% of the 116 measures reported. This figure 
reduces to 36% when the studies designated as "poor" are eliminated. 
Intel 1 igence measures were least often afffected rand "miscellaneous 

atJtter" measures most affected (75%). Hany of the lattel- would not be 
considered achievement measures. Reading and general achievement com- 
bined were positively affected only 35% of the time. When only good 
studies were considered, this reduced to 33%- 

' When the effects on reading-dad general achievement are analyzed 
by type of training progranj, the results fail to support any particular' 
approach to ability training. Kephart-Getman* (^♦2%). and "other visual 
perceptual" programs (6l%) enj<^*more success than do Frost ig (17%), 
Oelacato (20%), auditory perceptual' (33%) or ^^ther abilit/' programs 
(38%)* 

^ ^ Assgmpt ion 5: ' . * 

Hatching Instruction to Learner Strengths 
The final issue of concern is whether knowledge of a child's 
profile of strengths and weaknesses is useful in planning academic 
instruction. This approach is based on the supposi t ion that aptitude- 
treatment interactions exist.' Such a stX^tegy may imprc»/e learning 
eventhough the weak abilities themselves are, resistant to training. 
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Jo illustrate, for a child who i^ diagnosed as an "auditory learner,*' 
it is reconroended that academic instruction be provided through the 
auditory channel rather than through the weaker visual channeT (Johnson 
& Myklebust, 1967; Wepfnan*, 1971; ind Lerner, 1971). ' 

The standard research paradigm employed in these "modality matching" 
studies involves i den t i f y i ng ch i 1 dren ' s strong and weak modalities through 
an instrument likethe ITPA . Next, some children receive academic instruc- 
tion-through their strong modality while others receive instruction 
through their weak modality. Final ly,, achievement is stucfied to deter- 
mine if children whose instructional program matched their modality 
strengths surpassed those whose progr^^i^atched their niodality weakness. 

Arter and Jenkins (1977) and Ysseldyke (1973) have reviewed the 
modality-matching research. Arter.and Jenkins' review is -the more - 
"comprehensive, including 15 studies in which children identified as 
auditory, visual or kinesthetic learners were presented with reading 
instruction based on auditory, visual or kinesthetic approaches. In 
1^ of the 15 studies, rratchisg instruction with modality strength 
failed to produce differential i mproveme/it ; children learned equally 
well whether or not instruction was matched to their strong modality. 
In no study involving e.lementary aged students was the approach 
successful . ^ ^ , 

The consistently negative nature of these results casts consider- 
abl^ doubt on th^ usj^fulness of ability assessments in p'l ann i ng- academt c 
instruction. ' However, moda,).! ty studies to date have been concerned with 
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reading instruction; otherv«cademi c areas may be more ^menable to^ 
modal i ty iRf luenc^. 

SUMMARY AND DISCUSS I ON . ' 

Criticism of the DD-PT model is based upOn philosophical, theoret- 
ical, and empirical considerations. In this section the va!i*dity of the 
five assumptions which underlie the DD-PT model is discussed in light of 
existing evidence. 

^ Assumpt i on 1 : 

\ Existence and Measurabi 1 i ty of Abilities t 

Income ideal sense educationally relevant abilities may exist 
and b% measurable. However, two major obstacles have thwarted attempts 
to identify and assess educationally important abilities. One isv 
def initiorUl while'the other" is measurement-related. The terminolo^— ^ 
used by DD-PT has posed a significant -p^^oblem sincg^ there is little 
agreement as to what is meant by many of the ability labels. For example, 
^ Hani7)j I I (1972) in reviewing^ 33 studies of ^'perception*' found that some 
authors considered perception as ^he entire perceptive process from 
stimulus reception to cognitive analysis. Other authors made a rfi s- 
t'inction betwei^fT^ensati on" (receiving stimuli) and *'percept i on*" (the 
remainder of the:'"process) Still other writers distinguished between 
sensation and ,cogn i t ioH, with "perception" subsumed under the rubric of 



"cognition." Finally, there, are those who distinguish among ''sensat ion,' 
"perceVion'^ "cognition.". In the latter case, the processes which' 
involve thinking are assigned to cognition, while those dec^^^ng with 
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jionsymbo) ic , nonabstract properties of stimuli are relegated to per- 
ception. These differences i n "termi nology not only make communication 
difficult, but also make , tests and their results ambiguous, especially 
for those attempting to design remediation materials. / 

Those attempl^^^ to support the, first assumpt ion .of DD-PT encounter 
another obstacle, namely the measurement of hypothetical constY'ucts. 
Test developers attempt to label their instruments to indicate the • 
variable under consideration. When that variable is an abstract concept, 
there is no guarantee that ^e measure actually taps that construct. An 
example comes from the ITPA which purports to test psychol ingu i s t i c 
ability. Waugh (1975), after reviewing the research on reliability and 
validity of the ITPA , concluded that the test does not measure psycho- 
linguistic functioning, but instead measures cognitive functioning, that 
is, i ntel 1 i gence . 

. An underlying ability is assessed by measuring p^erformance on , 
activities which are thought to require the ability. Unfortunately, 
no activity can be considered a pure measure of an isolated ability. 
Any assessment task is susceptible to contam4 nat ion* by irrelevant (with 
'respect to the target ability) features of the task. For example, 
putting shapes in a sequence depends not only on *'vlsual sequential 
memory" but also on' the motor abjlity to physically manipulate the 
shapes and the ability to understand the verbal instructions V|{h.ich 
detail the task^requi rements. • 

Thus, even though Assumption 1 tannot, in priTKriple, be cJisproven, 
Its acceptance would seem to require either an act of faifh or empirical 
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denx>nst rat Ions of the efficacy of the DD-PT model. The latter is the 
subject of the next assumptions. 

Assumption 2: 

Reliability of the Tests Used^n Differential Diagnosis 
Measurement authorities suggest that Vf important decisiorrs are 
to be made on the bas^s of a test, then that test should produce retest 
reliability coefficients of at least .85- The median reliabilities of 
'the most frequently employed tests for the DD-PT do not meet this mini 
criterion; the median reported reliability for the ITPA subtests-, is .71 
and for the DTVP Total Score is .79- ' The median reUabi lities of many 
of the ITPA >and DT^subtests, which are used to prescr i be, d if f erent 
^klnds of ^Instruct ion^ are evT&n lower. 'Rel iabi 1 i ties of other tests 
, commonly used in DD-PT range from. .35 to .90 with a fbedian of .3}. . 
Clearly, the evidenc^e on r#»li^inty of DD-PT instruments does not jus- 
tify confidence in their continued use as a basis for making important 
educatTonal decisions. 

^ ' Assumption 3 

Validity of the Tests^Used irKj)^erent lal Diagnoses 
" 'Instruments employed in DD^^^T were examined r-n connection with four 
types of test va 1 i d 1 ty . J^earch indicates that while individual investi- \ 
gatipns*occdsional jXreport sat i $factor*y correlations, overal T resul ts 

have not proven/d i f ferent ia I'abi 1 i ty tests" to^ concurrently valid- with 

/ ' " ' . • . - • I ' ' 

respect to^cademic achievement. Exc^l^tions include ITPA Grammatic \- . * 
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Closure and Total Score fpr read ing' ach ievemen t , and the . DTVP Total 

Score for artt+imetic achifevenient. S.tudies in'which l(i is controlled 

r^pi^t far fewer differential ability-achievement re^tionships than 

do sillies which do not partial out IQ. 

.With regard to the 'pred i ct i ve vali<ljty of DD-PT. instruments, current 

research is difficult to interpret. To begin with/only a few longi- " 

tud i nal ^tud ies have focused u^on one instrument, and these "studies f^int 

4. 

an ambiguous picture. Often one study "t/i 11 suggest that an instrug>ent 
meets minimum validity standaf^> but the next study will give a cont/ary 
indication. Moreover, nearly all of the longitudinal studies have 
neglected to control /or the contribution pf IQ, which itself can account 
fqr an apparent relationship between DD-f^T measures and later achievement. 
Given these qua 1 i f i-cat i ons , it appears that the strongest case for 
predictive" vaVidity can be made for certain auditory measures (e.g., jJP^ 
Auditory Association). ( ^ ^ 

Studies' of the diagnostic validity of DD-PT 'instruments yield a 
similar picture. Neither the 'JTPA noi||fi seel 1 aneous visu^T percept ion 
tests appear capable of discriminating between good and poor readers. 
Auditory perceptual tests, in contrast, have ^n encouraging record. 
There have been few studies which examine the diagnostic validity of 
undef lying'abi 1 ities with regard to academi c area^ ottter than reading; ^ 

The results of studies which consider construct vafidity have 
yielded mixed results. There is some support for at least two d imens ions 
' *io the ITPA . TheVe is no\mpirical support for the five separate abili-^^ 
ties hypothesized by^Frostig, nor has there been a consistent ^series of^ 



T 
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^dlmen54pns delineated for auditory t^sts in%ene/a1. -Intelligence 
,appeafrs to be a srtrong g§n'era1 . factor in most of the tests, suggesting 
»to some'that "spectfic*^ ability. tests are, afbest, measures of general 
ijpteVledtuaJ ability.. . ^ 



Ifwestl^atPonsi of »rel iabi i i ty and 'val idi ty dc^^'not provide the 
'/ ultimate test of DD-PT* ^9^K)r premise of the flwdel is that these / 

. X' * - ' abilities *r^crucia> for/aL^^Jc success, that if an^J||^lity is weak V 
It'^can be trained, and that such training will .result fa imp roved academic 
' perfprmance. If correlations between underlying abilities and academic 
aehievement 'were high (which they are no^', there would be corroboration 
foff but not .proCjri)f- this essential proposition, since correlatfon does ^ 
' not imp»y"causation. Similarly, If cons its ten f factor^ Were found in" 

factor analytic research though for the most part thfey were not. It 
- t 'would aga^ provide corroboratifi^evidence, bjJt not proof of the essecitial 
pr^si^ioa. ^ proves' that the ability trairiing approach is useful.,/ one^ - 
muW identify weaknesses, train them',, and observe subsequent improvement 
' / .on'5c#<femic pftrt^|^ance. Or, alternatively, one must Itientlty^s'trefngths. 

and weaknesses; plan i/l*truct »oci in accord with them, ahd cjeponjtrate 



^ tHaf suob' instruction fs differentiayy effective. . 

, • '. . \ ' - , Assumption h\ ' « • 

. ^ . '\ « 

,■ • " ' - ~ . Eff ects of Abi 1 i ty 'Praining 

'There 'have been many attempts to train specific abi-1 iti-e?.. Psycho- 



T'rvgulst'ic, visual'' pApeptual , auditory pierceplual ^ndmpiwi- abilitiej 
have all iJeen the -focus of triii'jiing.. Thf training Uself has teen balsei 
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on various theoretical positions re lated * to ^the ITPA, ?eabody Language . 

Kits, Doman-Oelacito Methods^ Kephar,t-Getman programs, the,Pro9tig^ *; 

Horne program," and a number of miscellaneous perceptual motor programs. . 0 

Ability trlj^ng -succeeded about 24% of-tne time in well designed 

ih^estlqa^ons. Tt is difficult to escape t^e ^cpnclusion that abilities - 

measure^n differential diayfes-is ai-e highly resistant t,o training by 

existing procedures. ^ , 

% 

friven thTs, it. would certainly be surprising to find that ability 
train! ng . improved academic performance. Indeed, the research show$ , 

that more oftenr than not^ademic performance is ndt^ iflfiproved', ^kcludi^ng 

^4. If. 
studies. deS^iJgnated as poor 1 y^^ des i gned , ability trained groupi^ out-per- 
formed) untrained controls on roughly one-third pf ^e* academi^ measures , 
taken. In *ti»e 'major i^y of studies^, cootrol groups perf ormed^a^^^ on 
. both atiility and academic measures as did the experimental grouprsy 

• ' L " ■/" '• # 

Thus% Assumption k lacks support. • i, . ^ ' ^ 



^ * y Assumpt ion 5/- 

t" Diffe^r?ntial 'DiagnosJ»^lmprove» Acac^amic Pr'd^ramfjring 

Advocates of DD^PT propose that d i f ferent i a IL^ agnoS i s helps the 
. teacher to^tVrmi ne.how 'b' fchi Id should be taugh/. Th^ particular 
' constellation of psychological abijpties ideat^.fied throQgh* d i f feren 
diagnosis Js saic^to reveal individual leading styles whi^h, 
d'eter\jine 'special instrCictional methodol^igi^s and materials. 

To date there are 1A 'reported efforts to improve ibeg i nni re&d i ng 



by matching instructionaTmater iaJs and procedures to 'chi ldi4*i^' $ modality 
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strengths. In none of these wa,s reading instruction impijpved by n^^lity- 
instructionaj' m9tching. In one study conducted with secondary^ed^ 
students the approach appeared to succeed. A^'sumptlon 5 JOT'Cars to lack, 
even minimal empirical support. 




Reasons for the Lack of Support for the DD-PT h^el 

A number of explanations have been po^^^fch^t could account for this 
general fai lure to ^li^ort the' DD-?T nj^^e 1 •Wer S' Jenkins, 1977; Hammill 
.& Larsen, 197^a; ilinskof f , 1975rXwcofner et al., 1975; and Proger et al>, 
1973)-. 

First, the abil>t^ training model may itself be invalid. Underlying 
abi 1 i ties, mav^t exist as sjjch, dr they may exist but be an unimportant 

factq^'Tn i.nstruction. - ' • 

^ f> ' ' 

Another possible explanation for the failure of DD-PT is that even 



.thoirgh undfer^lving |bilities may ' ex i st Ibnd may be functionally related to 
achievement, tt>ey produce'-ecLly a weak. effect that is easily masked by 
stronger, uncont|Dlled variables'.' There Jre two issues concerning this." 



3» 



int. Firsf, Mjnskoff (1975) and Reogh (197^») argue that abj 
training Kas not been successf i»l 1 y demonstrated because of poor 1 y des i gned 
studies. - Th^* coritend'^that, in general, the rersedrch suffers fromluncon- 
tfoHed teacKer effects, Hawthorne effect* , -experimenter effects' (no 
double-blifid),^and subject selection problems. Responding to" this point 
Newcomer et al., (1975) argue that titere would-be evpn less,^vi denc^e to/ 
support DD-PT ,i f 6he research me t'hodo logics were iijipf oved , ' s i nee the 
uncontrolled sources of bias*, usual ly favor the, DD-PT^groups . In general, 
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experimental subjects received more one-tQ-one training tfvan h\d controls 
experiments tended^to be conducted by investigators who expecte'd ^o-^find 
-treatment effects, novelty effects favored ability trained groups , and 
regression effects were <?Ften qot considered. In fact, the stydies* which 
employed bet te^Pfesearch , designs less often supported ability train*ing. 
Quality of research designs is not a plaasabjfe explanation for 'failure 
to demonstrate DD-PT success. 

The secpnd issue related to masking variables is tbat of classroom 
.usefulness. If the effects of underlying abilities are easily masked by 
other, more robust variables,' then attention should be focused On those 
stronger variables. . * 

third explanation for the lack of suppon'i for the PD-PT approach 
is related to the prescriptive/remediation programs. With regard to 
l^ility training, the i ns t ruct i oha] programs ^ themse I ves ma/ need to be 
strengthened, or "abilitfes" identifi.ed for tr'd'ining [nay need to be ^n9^re 
carefully selected. Williams (1977) argues that ability training may be 
useful if the abilities are chosen very careful ly^o that they are: 
Important components of the read i ng ^tasl4 (e . g . , sound blending). , How- 
ever, she cauticiis against existing auditory ability training programs: 
^ However, y^e are not proposing that training in auditory perceptual 
skiMs, generally speaking, will lead *to better . achie vemen t in' 
reading. Trfe lesions from the past|ppK> or three decades. on the 
relationship of visual-perceptual skills and reading heve^ con- 
vincecT us otherwise. When we reviewed several recently developed 
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and popular auditdry programs (many of which a^re^ listed b^Kass,, 
1972), we were dismaye/to find content coverage or methodolog'^^ 
•which, on the bas i s (>t current Icnowledge abou-t perceptuaT ski 1 1 s^ 
and instructfonaT" meThodology, -was surprisingly poor. Tor 
example, there is often excessive emphasis pn material unrelated 
to that of early reading skills $te.g.% children are asked to 
identify the animals who make different barnyard sounds). Somef 
tines language tas^s are presented in a context quite different 
from that of inftial decoding. For example, two voi c^present ^ 
two separate messages concurrently aryl the child must focus his 
atten^i_on on only one of the conflicting messages. - Sometimes 
relevant .tasks are pres'ented,. but in a way. which would tax 
the child's memory or confuse' him. In addition, one^program, 
dealing with the important ski 1 1 of aud i tory ^na 1 ys Ts , develops 
tasks to a level of difficulty far beyond that required for 
initial decoding; some programs present what could -be classified 
as practice material but^^no instruction; and blending as a 
■ procfiss is not taught'in any of. the programs. (pp. 28^-^85) 
With regard to >moda 1 i ty ^match i ng , instructional programs may Vfft Suffi- 
ciently emphasize one modality to thj^e^p lusion qf others. Indee^J, thi 
may not everi^be possible (Vande^e# and Nervi He , 197^) since reading 

ar^j^i s 

w 

taught. ^ : ^ ^ , ' • , 

Fourth, abili.ties may exist and be -useful, but test^'have not been 

d&veVoped yet Which consistently and accura'te 1 y reveal Ability profiles 



see^ps to require both auditory ar^j^^sual ski 1 1 s ^o flratter how \t is 
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The reliAilities and validities of ^current DD-PT, tests fre often 
unsatisfactory. * ' , 

•A fifth explanation for the latk Of pos i t i v^pD-PT results involves 

^factors relating to mdi v i duaJ i zat i on of instruction. Minskoff (1975) 
arqu^d that the Dt)'PJ model is effective, but that it has not been fairly 

' tested. \Sh^ points out that one premise of the model, and irvdeed or 
Bdi^c^t4oa iri*g||neral, is that i nstruct io% must be geared to f^ind^vi- 
dual' nee^^ of each student. Therefore, studies employing dfWerent 
populations and treatments should not be compared nor should studies' 
which provide one«treatment to a^lar^g^ group- of chi Idren be expected to 



show overall effects. She a 1 so' proposes that most DD-PI||pphn iques 
could really be expected to work only wi th. seve<-ly disabled populations. 
Nev^omer ef al. (1975) have countered this argument, citing Hanmill and 



Lar'sen (1974a) who failed to locate an. advantage for inrdi vidual Pked over 
nor^individuali^ DD-PT programs. Newtomer .et al. also point ouK^hat 
- Hiost test and program developers reconmend their products for use with 
any children who evidence ability def i c i ts , ^ not just the severely dis- 

abled.. Moreover, , several reviewers (e.g., Hahlahan, &• Crurckshank, 1973; 

* 9 ' ' * 

Hammill 6 Larsen, ]S7^*a) have analyzed results by population, program, 

\ ■ • ^ 

and criterion test and^still the results cemain unifoiynly negative. 

f Whije ^e DD-?T model may^ ' i rf theory , be responsive to different popula- 
^'tions of. ..learners^ the 'burden of proof rests with proponents of the 
* model (Hammill S Larsen, 1974a). " > ?f,, 

Ih summary, i t i s not surprising that- DD-PT has not improved 
academic achievement, since most^ ability assessment desn<es have 

60 , 
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inadequate reliability and sxispect validi.ty. Moreover, abilities them- 
selves have resisted training, and given th^ fow correlat ions between 
abJlity assessments and reading achievement, jt'is not sijrprising that 
moda 1 i ty- i n^truct ional' match i ng has faifed to improve achievement^] 
«the repeatect failure to support the^*tas'ic assumptions under lyi^ng 

\ / . , * 

the DD-PT model casts rfouit' on the model's validity. We do not intend 
to sugges^t that tne kTx>d§l i s '^heorjet i ca 1 ly uMenable, or th^t it may 
not one da^ be effectiveTy implemented, leather, we believe that with 
the current instructional programs and* test^ iHTs model^is not. useful* 
A number df authors who have reviewed specific aspects' of the DD-*RT, 
model have arrivdcj-^t a sTmilar conclusion (HammJ 1 1 & Larsen, 197^b> - 
Sedlack &^Renl^r, V973; Silverston SDeichmari, 1975;^ and Ysseldyke, 
1373). For^xample, with reference to psychol ingi^t i c training, * 
Newcomer et al.'(l975) write: " . % ^ >f . ^ 

We[ cannot help but conclude ^hat psychol i ngu i s^t i c training ^ased 
on the Kirk-O'sgood model is not .successful because i t does not 
help children to increase thei r *abi 1 i ty to speak' or understand 
language, noc does it aid them in academic skTlls such as 
reading,, writ ingor spe 1 H ng. the wrong skills are being 
remediated. {p. 1^7)^ 

Unfortunately, this vi^w does^n^ represent that held by most 
authorities and practitioners in special e*ducation. The-^-PT model 
is preferred by the va^t majority of spec i al . educat iort teachers (Arter 
6 Jenkins, 1977). In a s-tate-wide survey of Illinois it was found that 
82% o? special education teachers Relieved that they coiild^ and should, 
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train. weak abi 1 i t ies ,-'99%t,t^ought that a ch i 1 d ' s" iroda 1 i ty strengths and 
weaknesses shoultl be a fhajor consideration when devising educational 
prescriptions, and 33% believed that their students had learned more 

en^ they rTK)dif ied instruction to match inodality strengths. The same 
survey provided data to suggest that teacher training programs were', 

4 

tC a large degree, responsible for these views and practices. Unsup- 

pqrted expert opi-nion and teacher training programs resulting^om this 

opinion appear W.have a direct, deleterious effect on teacher behavior 

and an indirect effect on children's learnirrg. Not only are teachers 

adhering to an ineffective model, but because they have been persuaded 

that the model is useful, they are^^ss apt to create variations in 

instructional procedures which w»i 1 1 result in improved learning.' We 

beljeve that until a substantive research base for the DD-PT model has 

been developed, it i-s imperative to call for a moratorium on advocacy 

» 

of OO-PT,. on classification and placement of chfvdren ^^ccording to < ^ ' 
differential ability tests, on the^purchase of in^i^tional materials 
and programs which claim to improve these abilities ar*^ on coursework 
desf^TV&i to train DB-PT teachers.. • • , " 
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^ Percentage of Successful OlscTrimination^ Between Reading Groups 
by Various Measures of Visual Abilities and Auditory Abilities 
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